Skip to main content

Internet Archive Web Crawls

The Internet Archive discovers and captures web pages through many different web crawls.



rss RSS

1,672,714
RESULTS


Show sorted alphabetically

Show sorted alphabetically

SHOW DETAILS
up-solid down-solid
eye
Title
Date Reviewed
Creator
Survey Crawl Number 7
Jan 6, 2022 Internet Archive
web

eye 812,984

favorite 0

comment 2

Internet Archive crawldata from Survey Webwide Crawl, captured by crawl841.us.archive.org:survey from Sun Mar 4 08:25:03 PST 2018 to Mon Mar 5 18:20:40 PST 2018.
favoritefavoritefavoritefavoritefavorite ( 2 reviews )
Topic: crawldata
Google Video
Dec 17, 2021 Internet Archive
web

eye 44,246

favorite 1

comment 1

Internet Archive crawldata from Google Video archiving project 2011, captured by crawl340.us.archive.org:gvdocinfo from to Wed Jul 27 15:47:37 PDT 2011.
favorite ( 1 reviews )
Topic: crawldata
Wide Crawl Number 17: Started August 3rd, 2018
Dec 8, 2021 Internet Archive
web

eye 5.5M

favorite 1

comment 3

Internet Archive crawldata from Webwide Crawl, captured by crawl805.us.archive.org:wide from Mon May 13 17:55:38 PDT 2019 to Mon May 13 13:45:55 PDT 2019.
favoritefavoritefavoritefavoritefavorite ( 3 reviews )
Topic: crawldata
Wide Crawl started February 2014
Nov 11, 2021 Internet Archive
web

eye 8.2M

favorite 0

comment 1

Internet Archive crawldata from Webwide Crawl, captured by crawl426.us.archive.org:wide from Wed Feb 19 07:58:38 PST 2014 to Wed Feb 19 05:13:46 PST 2014.
favoritefavoritefavoritefavoritefavorite ( 1 reviews )
Topic: crawldata
Youtube Videos
Oct 17, 2021 Internet Archive
web

eye 32

favorite 1

comment 1

Internet Archive crawldata from YouTube Video archiving project 2011, captured by crawl810.us.archive.org:youtube from Fri Feb 26 01:27:26 PST 2021 to Thu Feb 25 17:45:49 PST 2021.
favoritefavoritefavoritefavoritefavorite ( 1 reviews )
Topic: crawldata
Live Web Proxy Crawls
Sep 24, 2021
web

eye 105.3M

favorite 5

comment 1

favoritefavoritefavoritefavoritefavorite ( 1 reviews )
Wide Crawl Number 15: Started Oct 1st, 2016 - Ended May 8th, 2017
Jan 30, 2021 Internet Archive
web

eye 820,397

favorite 0

comment 1

Internet Archive crawldata from Webwide Crawl, captured by crawl814.us.archive.org:wide from Sat Oct 1 15:28:56 PDT 2016 to Sun Oct 2 23:53:49 PDT 2016.
( 1 reviews )
Topic: crawldata
Wide Crawl Number 14 - Started Mar 4th, 2016 - Ended Sep 15th, 2016
Jan 30, 2021 Internet Archive
web

eye 1.6M

favorite 0

comment 1

Internet Archive crawldata from Webwide Crawl, captured by crawl824.us.archive.org:wide from Thu Jun 16 19:15:17 PDT 2016 to Fri Jul 1 20:09:14 PDT 2016.
favoritefavorite ( 1 reviews )
Topic: crawldata
YouTube 2007 Crawl
web

eye 80,202

favorite 0

comment 1

This is an element of the Crawl IA-YOUTUBE-000 dataset from InternetArchive
favoritefavoritefavoritefavoritefavorite ( 1 reviews )
Youtube Videos
Nov 28, 2020 Internet Archive
web

eye 931,228

favorite 0

comment 1

Internet Archive crawldata from YouTube Video archiving project 2011, captured by crawl440.us.archive.org:youtube from Sat Jul 21 05:39:04 PDT 2012 to Fri Jul 20 23:46:43 PDT 2012.
favoritefavoritefavoritefavoritefavorite ( 1 reviews )
Topic: crawldata
Live Web Proxy Crawls
Nov 28, 2020
web

eye 47.3M

favorite 4

comment 4

favoritefavoritefavoritefavoritefavorite ( 4 reviews )
Youtube Videos
Sep 15, 2020 Internet Archive
web

eye 20

favorite 0

comment 1

Internet Archive crawldata from YouTube Video archiving project 2011, captured by crawl819.us.archive.org:youtube from Tue Sep 15 17:12:41 PDT 2020 to Tue Sep 15 10:32:19 PDT 2020.
favoritefavoritefavoritefavoritefavorite ( 1 reviews )
Topic: crawldata
Live Web Proxy Crawls
Jul 1, 2020 Internet Archive
web

eye 2.4M

favorite 0

comment 1

Internet Archive Liveweb Capture from WayBack Machine, captured by wwwb-live3.us.archive.org from 2013-06-11T17:38:46 UTC to 2013-06-11T21:24:17 UTC.
favoritefavoritefavoritefavoritefavorite ( 1 reviews )
Topic: crawldata
Wayback Indexes
web

eye 7.1M

favorite 0

comment 1

Data crawled by Internet Archive on behalf of Internet Archive from Fri Nov 01 06:23:33 PDT 2002 to Tue Nov 19 23:24:07 PDT 2002
favoritefavoritefavoritefavoritefavorite ( 1 reviews )
Topic: crawldata
Youtube Videos
Aug 1, 2019 Internet Archive
web

eye 26

favorite 0

comment 1

Internet Archive crawldata from YouTube Video archiving project 2011, captured by crawl823.us.archive.org:youtube from Thu Aug 1 06:21:17 PDT 2019 to Wed Jul 31 23:31:25 PDT 2019.
favoritefavoritefavoritefavoritefavorite ( 1 reviews )
Topic: crawldata
Youtube Videos
Jul 4, 2019 Internet Archive
web

eye 27

favorite 0

comment 1

Internet Archive crawldata from YouTube Video archiving project 2011, captured by crawl821.us.archive.org:youtube from Mon Feb 11 12:34:17 PST 2019 to Mon Feb 11 04:48:30 PST 2019.
favoritefavoritefavoritefavoritefavorite ( 1 reviews )
Topic: crawldata
Live Web Proxy Crawls
Apr 4, 2019 Internet Archive
web

eye 20M

favorite 7

comment 1

Internet Archive Liveweb Capture from WaybackMachine, captured by wwwb-proxy0.us.archive.org:wbm from Sun Mar 27 22:10:09 PDT 2011 to Mon Mar 28 05:27:05 PDT 2011.
favoritefavoritefavoritefavoritefavorite ( 1 reviews )
Topic: crawldata
Live Web Proxy Crawls
Mar 9, 2019
web

eye 57,093

favorite 0

comment 1

favoritefavoritefavorite ( 1 reviews )
Live Web Proxy Crawls
Dec 13, 2018 Internet Archive
web

eye 1.6M

favorite 0

comment 2

Internet Archive Liveweb Capture from WayBack Machine, captured by wwwb-live3.us.archive.org from 2013-08-14T05:36:46 UTC to 2013-08-14T16:31:43 UTC.
favoritefavorite ( 2 reviews )
Topic: crawldata
google ngrams
Dec 26, 2013 Google, Inc.
web

eye 28

favorite 0

comment 1

This item contains the Google ngram data for the American English languageset. ​​​​​ Here are the datasets backing the Google Books Ngram Viewer. These datasets were generated in July 2009; we will update these datasets as our book scanning continues, and the updated versions will have distinct and persistent version identifiers (20090715 for the current set). Each of the numbered links below will directly download a fragment of the given corpus. For instance, the first ten links...
favoritefavoritefavoritefavoritefavorite ( 1 reviews )
Live Web Proxy Crawls
Aug 6, 2013 Internet Archive
web

eye 1.7M

favorite 0

comment 1

Internet Archive Liveweb Capture from WayBack Machine, captured by wwwb-live4.us.archive.org from 2013-07-13T11:35:01 UTC to 2013-07-14T12:32:30 UTC.
favoritefavoritefavoritefavoritefavorite ( 1 reviews )
Topic: crawldata
merged crawl logs from wide00010
Wide Crawl started April 2012
web

eye 958

favorite 0

comment 0

Internet Archive crawldata from Webwide Crawl, captured by crawl416.us.archive.org:wide from Wed May 9 13:25:07 PDT 2012 to Wed May 9 08:12:19 PDT 2012.
Topic: crawldata
Wide Crawl started June 2014
data

eye 0

favorite 0

comment 0

merged crawl logs from wide00011
crawl_UNK
web

eye 32

favorite 0

comment 0

This is an element of the Crawl UNK dataset from Alexa Internet
crawl_UNK
web

eye 25

favorite 0

comment 0

This is an element of the Crawl UNK dataset from Alexa Internet
crawl_UNK
web

eye 33

favorite 0

comment 0

This is an element of the Crawl UNK dataset from Alexa Internet
Youtube Videos
web

eye 4

favorite 0

comment 0

Internet Archive crawldata from YouTube Video archiving project 2011, captured by crawl824.us.archive.org:youtube from Wed Sep 2 07:42:50 PDT 2020 to Wed Sep 2 01:56:35 PDT 2020.
Topic: crawldata
Youtube Videos
web

eye 4

favorite 0

comment 0

Internet Archive crawldata from YouTube Video archiving project 2011, captured by crawl837.us.archive.org:youtube from Thu Sep 3 08:19:57 PDT 2020 to Thu Sep 3 02:38:07 PDT 2020.
Topic: crawldata
Youtube Videos
web

eye 4

favorite 0

comment 0

Internet Archive crawldata from YouTube Video archiving project 2011, captured by crawl810.us.archive.org:youtube from Mon Aug 31 05:01:08 PDT 2020 to Sun Aug 30 22:11:31 PDT 2020.
Topic: crawldata
Youtube Videos
web

eye 4

favorite 0

comment 0

Internet Archive crawldata from YouTube Video archiving project 2011, captured by crawl819.us.archive.org:youtube from Mon Aug 31 04:16:23 PDT 2020 to Sun Aug 30 21:34:00 PDT 2020.
Topic: crawldata
Youtube Videos
web

eye 4

favorite 0

comment 0

Internet Archive crawldata from YouTube Video archiving project 2011, captured by crawl824.us.archive.org:youtube from Mon Aug 31 01:55:09 PDT 2020 to Sun Aug 30 19:05:22 PDT 2020.
Topic: crawldata
Youtube Videos
web

eye 4

favorite 0

comment 0

Internet Archive crawldata from YouTube Video archiving project 2011, captured by crawl860.us.archive.org:youtube from Mon Aug 31 03:28:25 PDT 2020 to Sun Aug 30 22:04:21 PDT 2020.
Topic: crawldata
Youtube Videos
web

eye 4

favorite 0

comment 0

Internet Archive crawldata from YouTube Video archiving project 2011, captured by crawl824.us.archive.org:youtube from Sun Aug 30 01:21:08 PDT 2020 to Sat Aug 29 18:41:42 PDT 2020.
Topic: crawldata
Youtube Videos
web

eye 4

favorite 0

comment 0

Internet Archive crawldata from YouTube Video archiving project 2011, captured by crawl834.us.archive.org:youtube from Mon Aug 31 02:06:29 PDT 2020 to Sun Aug 30 19:18:53 PDT 2020.
Topic: crawldata
Youtube Videos
web

eye 4

favorite 0

comment 0

Internet Archive crawldata from YouTube Video archiving project 2011, captured by crawl821.us.archive.org:youtube from Mon Aug 31 05:27:10 PDT 2020 to Sun Aug 30 22:42:48 PDT 2020.
Topic: crawldata
Youtube Videos
web

eye 4

favorite 0

comment 0

Internet Archive crawldata from YouTube Video archiving project 2011, captured by crawl819.us.archive.org:youtube from Mon Aug 31 08:41:33 PDT 2020 to Mon Aug 31 01:58:00 PDT 2020.
Topic: crawldata
Youtube Videos
web

eye 3

favorite 0

comment 0

Internet Archive crawldata from YouTube Video archiving project 2011, captured by crawl860.us.archive.org:youtube from Mon Aug 31 07:41:27 PDT 2020 to Mon Aug 31 00:53:11 PDT 2020.
Topic: crawldata
Youtube Videos
web

eye 4

favorite 0

comment 0

Internet Archive crawldata from YouTube Video archiving project 2011, captured by crawl834.us.archive.org:youtube from Tue Sep 1 02:44:16 PDT 2020 to Mon Aug 31 19:58:10 PDT 2020.
Topic: crawldata
Youtube Videos
web

eye 4

favorite 0

comment 0

Internet Archive crawldata from YouTube Video archiving project 2011, captured by crawl824.us.archive.org:youtube from Tue Sep 1 02:49:08 PDT 2020 to Mon Aug 31 19:59:44 PDT 2020.
Topic: crawldata
Youtube Videos
web

eye 4

favorite 0

comment 0

Internet Archive crawldata from YouTube Video archiving project 2011, captured by crawl834.us.archive.org:youtube from Mon Aug 31 13:05:12 PDT 2020 to Mon Aug 31 06:21:36 PDT 2020.
Topic: crawldata
Youtube Videos
web

eye 5

favorite 0

comment 0

Internet Archive crawldata from YouTube Video archiving project 2011, captured by crawl860.us.archive.org:youtube from Sat Sep 5 12:36:01 PDT 2020 to Sat Sep 5 05:52:51 PDT 2020.
Topic: crawldata
Youtube Videos
web

eye 4

favorite 0

comment 0

Internet Archive crawldata from YouTube Video archiving project 2011, captured by crawl822.us.archive.org:youtube from Sat Sep 5 15:41:14 PDT 2020 to Sat Sep 5 09:14:35 PDT 2020.
Topic: crawldata
Youtube Videos
web

eye 4

favorite 0

comment 0

Internet Archive crawldata from YouTube Video archiving project 2011, captured by crawl810.us.archive.org:youtube from Sat Sep 5 09:10:14 PDT 2020 to Sat Sep 5 03:41:16 PDT 2020.
Topic: crawldata
Youtube Videos
web

eye 4

favorite 0

comment 0

Internet Archive crawldata from YouTube Video archiving project 2011, captured by crawl858.us.archive.org:youtube from Sun Sep 6 19:49:52 PDT 2020 to Sun Sep 6 13:49:01 PDT 2020.
Topic: crawldata
Youtube Videos
web

eye 16

favorite 0

comment 0

Internet Archive crawldata from YouTube Video archiving project 2011, captured by crawl110.us.archive.org:youtube from Mon Aug 24 05:42:09 PDT 2020 to Sun Aug 23 22:56:37 PDT 2020.
Topic: crawldata
Youtube Videos
web

eye 7

favorite 0

comment 0

Internet Archive crawldata from YouTube Video archiving project 2011, captured by crawl820.us.archive.org:youtube from Wed Sep 2 10:03:33 PDT 2020 to Wed Sep 2 03:57:56 PDT 2020.
Topic: crawldata
Youtube Videos
web

eye 7

favorite 0

comment 0

Internet Archive crawldata from YouTube Video archiving project 2011, captured by crawl822.us.archive.org:youtube from Sun Aug 30 13:19:28 PDT 2020 to Sun Aug 30 06:38:13 PDT 2020.
Topic: crawldata
Youtube Videos
web

eye 6

favorite 0

comment 0

Internet Archive crawldata from YouTube Video archiving project 2011, captured by crawl819.us.archive.org:youtube from Thu Oct 1 04:59:55 PDT 2020 to Wed Sep 30 23:45:15 PDT 2020.
Topic: crawldata
Youtube Videos
web

eye 5

favorite 0

comment 0

Internet Archive crawldata from YouTube Video archiving project 2011, captured by crawl861.us.archive.org:youtube from Sat Dec 5 11:07:00 PST 2020 to Sat Dec 5 03:17:17 PST 2020.
Topic: crawldata
Youtube Videos
web

eye 6

favorite 0

comment 0

Internet Archive crawldata from YouTube Video archiving project 2011, captured by crawl838.us.archive.org:youtube from Wed Dec 16 04:41:29 PST 2020 to Tue Dec 15 22:20:40 PST 2020.
Topic: crawldata
Youtube Videos
web

eye 10

favorite 0

comment 0

Internet Archive crawldata from YouTube Video archiving project 2011, captured by crawl858.us.archive.org:youtube from Mon Dec 21 13:54:11 PST 2020 to Mon Dec 21 06:23:02 PST 2020.
Topic: crawldata
Youtube Videos
web

eye 85

favorite 0

comment 0

Internet Archive crawldata from YouTube Video archiving project 2011, captured by crawl445.us.archive.org:youtube from Thu Dec 10 07:27:08 PST 2015 to Thu Dec 10 00:07:36 PST 2015.
Topic: crawldata
Youtube Videos
web

eye 4

favorite 0

comment 0

Internet Archive crawldata from YouTube Video archiving project 2011, captured by crawl440.us.archive.org:youtube from Thu Oct 13 02:15:30 PDT 2011 to Wed Oct 12 19:53:08 PDT 2011.
Topic: crawldata
Youtube Videos
web

eye 26

favorite 0

comment 0

Internet Archive crawldata from YouTube Video archiving project 2011, captured by crawl820.us.archive.org:youtube from Wed Sep 7 17:06:42 PDT 2016 to Wed Sep 7 10:23:37 PDT 2016.
Topic: crawldata
Youtube Videos
web

eye 49

favorite 0

comment 0

Internet Archive crawldata from YouTube Video archiving project 2011, captured by crawl819.us.archive.org:youtube from Wed Sep 21 22:10:00 PDT 2016 to Wed Sep 21 15:36:27 PDT 2016.
Topic: crawldata
Youtube Videos
web

eye 26

favorite 0

comment 0

Internet Archive crawldata from YouTube Video archiving project 2011, captured by crawl819.us.archive.org:youtube from Sun Oct 2 13:49:09 PDT 2016 to Sun Oct 2 07:06:40 PDT 2016.
Topic: crawldata
Youtube Videos
web

eye 33

favorite 0

comment 0

Internet Archive crawldata from YouTube Video archiving project 2011, captured by crawl819.us.archive.org:youtube from Wed Apr 26 06:07:38 PDT 2017 to Wed Apr 26 00:13:15 PDT 2017.
Topic: crawldata
Youtube Videos
web

eye 56

favorite 0

comment 0

Internet Archive crawldata from YouTube Video archiving project 2011, captured by crawl819.us.archive.org:youtube from Thu Jun 1 03:13:39 PDT 2017 to Wed May 31 21:04:38 PDT 2017.
Topic: crawldata
Youtube Videos
web

eye 28

favorite 0

comment 0

Internet Archive crawldata from YouTube Video archiving project 2011, captured by crawl820.us.archive.org:youtube from Tue Jun 19 11:08:03 PDT 2018 to Tue Jun 19 04:39:00 PDT 2018.
Topic: crawldata
Youtube Videos
web

eye 89

favorite 0

comment 0

Internet Archive crawldata from YouTube Video archiving project 2011, captured by crawl820.us.archive.org:youtube from Sun Jul 1 04:15:07 PDT 2018 to Sat Jun 30 21:57:34 PDT 2018.
Topic: crawldata
Youtube Videos
web

eye 38

favorite 0

comment 0

Internet Archive crawldata from YouTube Video archiving project 2011, captured by crawl822.us.archive.org:youtube from Mon Mar 26 13:19:35 PDT 2018 to Mon Mar 26 06:39:35 PDT 2018.
Topic: crawldata
Youtube Videos
web

eye 23

favorite 0

comment 0

Internet Archive crawldata from YouTube Video archiving project 2011, captured by crawl820.us.archive.org:youtube from Wed Dec 19 14:34:47 PST 2018 to Wed Dec 19 06:58:18 PST 2018.
Topic: crawldata
Youtube Videos
web

eye 11

favorite 0

comment 0

Internet Archive crawldata from YouTube Video archiving project 2011, captured by crawl821.us.archive.org:youtube from Wed Feb 6 09:36:26 PST 2019 to Wed Feb 6 01:50:46 PST 2019.
Topic: crawldata
Youtube Videos
web

eye 10

favorite 0

comment 0

Internet Archive crawldata from YouTube Video archiving project 2011, captured by crawl821.us.archive.org:youtube from Sat Jan 5 18:57:07 PST 2019 to Sat Jan 5 11:10:33 PST 2019.
Topic: crawldata
Youtube Videos
web

eye 24

favorite 0

comment 0

Internet Archive crawldata from YouTube Video archiving project 2011, captured by crawl820.us.archive.org:youtube from Thu Feb 7 18:33:26 PST 2019 to Thu Feb 7 11:09:43 PST 2019.
Topic: crawldata
Youtube Videos
web

eye 7

favorite 0

comment 0

Internet Archive crawldata from YouTube Video archiving project 2011, captured by crawl822.us.archive.org:youtube from Wed Dec 2 13:25:15 PST 2020 to Wed Dec 2 05:43:03 PST 2020.
Topic: crawldata
Youtube Videos
web

eye 6

favorite 0

comment 0

Internet Archive crawldata from YouTube Video archiving project 2011, captured by crawl817.us.archive.org:youtube from Fri Oct 23 23:46:18 PDT 2020 to Fri Oct 23 17:11:49 PDT 2020.
Topic: crawldata